Speechreading Essentia Signal, Paralinguistic Cues, A

An overview of some results from our own studies on speechreading is presented. Focus is on paralinguistic cues that assist in perception of the spoken signal. We elaborate on how the contextual, and especially the emotional cues are utilised in speechreading. We further discuss which skills are important in integrating paralinguistic cues and the linguistic signal in speechreading. As a basis for this overview, empirical data as well as hypotheses under scrutiny in a present design are discussed. Finally, some practical implications regarding synthetic faces as communicative aids are discussed: how the speech should be presented, incorporation of paralinguistic cues into the design, and how to match user and aid.